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PROBLEMS OF CONTROL iN NON- EXPERIMENTAL 
EDUCATIONAL RESEARCH * 



^ Each yeat throughout North America, hundreds of ^aduate stiidents 
in educatia' are exposed to the mysteries of the design^ and analysis of 
educi|piona£ ^experiments. Using the now classic treatise of Campbell^ 
a^nd Stanley C1963) they leara that many of the sources of invalidity .thatj^ 

cloud the investigation of relationships among educational variables, «can 

, ^ . . ' ' ...... ^ n 

be controlled through the use of "True Experiments"* They learn that in • 

the basic true experiment, subjects are randomly assigned to groups, the 

> 

groups ,are treated differential^ly, and qbservations are made to determine 
the effects of the treatment. The magic potion that controls the 
nuisance variables is random assignment* . " ' 

In spite of the validity of the claims mad^ .for the use of true 
experiments ine> educational research, by far, the bulk of educational 
research is not truly experimental. Campbell and Stanley's pre and quasi 
exp€;riment6,, the ex post fj^cto experiments 'of Chapin (1955), case studies, 

r 

field studies, and clinical methods are common (but not mutually exclusive) 

examples of not truly experimental (I^E) research' methods! * 

There are many reasons why NTE research flourishes Often people • 

cannot be randomly assigned to groups for ethical reasons, as for example 

» 

r 

in looking at difference^ in vistial acuity between deaf and hearing 
children. There maybe ladminlstratlve^ reasons that make random assignment 
Impossible as in a study of differences in teaching styles for teachers 
in rural and urban scHools. ' Sometimes -random assignment is impossible 
becatise the independent variable simply cannot be placed under the control 



of the resftarcher* (As for example in a 'study of the effects of an 
economic recession on the quality of decisions madep^by. school boards.) 
Indeed it is often true that the random assignment of subjects td 
groups produces such an artificial situation that it possesses ho 
geological validity in the "Bracht^nd Glass (1969) sense. " 0cca8ic:aally 

* ■ \- / \ • 

NTE^ research occurs ^s a result of poqr planning or ineptitude on the 

' patt of the repearcher. Regardless of the reasons for it^ use/ one of 

^ \ ^ ' . ^ ' 

the inevitable problems of NTE research is the confounding, qf 

"nuisance'' ^variables with other variables. ' ^ ' - . 

' . \ . * " ' 

Nuisance variabiles are variables that interfere with the relation 

ships among the principal variables under study. In the simplest • case 

\ 

they inject alternate po8(flbilities for causal statements lelating 
independent and dependent variables.^ Campbell and Stanley sources of 
iijternal invalidity are examples of nuisance variables » in that they 
provide alternate Explanations for differences that ^ay^ observed. Other 
variables are identified as nuisance variables only within the contest 
of a particular experiment. For example^ Anderson (1971), in a study to 
xletermine the effects of course content and teacher sex on classroom 
climate, treated the variables bf class siVe,. girl/boy ratio and claa^ 
mean IQ, as nuisance variables. Wessman (1972) treated IQ, age, and 
race ajs nuisance variables in a study of t:he effectiveness of a 
compensatory education program. . Aiken (1972) described several studies 
relating lariguage factors to learning in math^atics. Among the • 
nuisance variables that occurred were initial mathematics ability, IQ, 
and computational ability. 

That the confounding of nusiance. variables in the relationship 
between independent and dependent variables is regarded as an. important 
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problem in educational research Is well documented by th^ advice provided 



by rc^vlevers and. Integrators of reseall^ch In various area^« St. Joha 



(1970) for example strAed "If school quality and faplly background .are 
posltiveiy related to the achievement of minority pupils and tq their j 
schools* racial composition, it is crucial to control"t:hem in any study ' 

of the Influence of ethnic composition (and scHool performatK^) .''^ . 

^' • ' ^ ' , - . 

Welch (1969) after looking at several evaluation ^designs for mathematics ^ 

curricultoa studies » and finding a prepondiirance of uncontrolled studies,.* 

suggested that analysis of ^coyarlanca is ohe of the many techniques, that 

currlculimi evaluators can use to improve their investigations* Kerlinger 

(1967) tod, noted that "The necessity of oontrolling extraneous " Independent 

va'^^iables is particularly urgent in field experiments • 

There are three procedures that have been prescribed for problems 
of confoiindi^d nuisance variables in NTE research: matching, partial 
/correlation, and analysis of covarlance. Basically, they all attempt to 
I answer the same question", i£ the nuisance, variables were controlled, what 
wouI3 be the relationship between the Iftdejendent and dependent variables? 

Meehl (1970) , considereci the situation and suggested that the 
solutions may be^ generating mor^e problems than they solve. In the present 
paper an attempt is made to extepd Meehl's discussion, and to show" the 
implications that it has for educational research. Some of the problems 
to be discussed have bean covered' in part of Elasho^f (1969)* and by Evans 
and Anastaslo (1968). Problems associated with unreliability of ^ 
measurement and violations of assumptions have been'^^fix out by Lord (1963) 
an^ Glass et al (1972), and will not be reiterated here. , 



Meehl noted that the practice of contrdlling nuisance! variables 



in ex poat facto experiment ha^ such serious defects > th^i it is 
probably worthless for most scientifically interesting purposes. He 
. lis£s three reasons. 

1. Syatematic uimiatching * Supjfjose a study were- conducted in 

\ " ' . • . • ^ ^ . 

which the incomes of high school ^graduates and dropouts are ^compared. ' 

If thS^ graduates have higher income i't coulcl be argued that this results 

from dir5R^ in IQ; graduates having higher IQ*skthan dropouts in 

general. - If graduates and dropout)s are m&tched pairwise on the basis of 

# ^ ^ • • • « ' 

IQ; and a difference still exists in*\ncoi»e., it might be said that the 

. . / *. 

^ difference is not attributable to IQ. However, if we look carefully at 

; • ■ . . • 

a dropout' matched with a. graduate at IQ 125, we would have to admitcthat 
these are likely very different people. The dropout likely has a lower 
achievement need than the graduate at this level. Considering the match 
at IQ 90, we would f'urely admit that the graduate with an IQ of. that * 
level ha»^ a very high achievement ne^d. Meehl suggests that what we have 
done by^tchlng on IQ is to make thi^ gr^jpops uiuuat(^hed on achievement 
need. 

2. Unrepresentative,, subpopulat ions * When matched groups are 

formed using a nuisance variable which is highly correlatj^d wiJth on^ of 

the variables of interest, what we do in effect is to identify samples 

from subpopulations that differ from the entire population of itderest. 

For example, in studying the differences between teaching styles of 
< * 

teachers in upper class, middle .class, and lower cl^ss schools, it might 

. - . * 

be thought necessary to control for average IQ'o^ students, size of 
clas^, kinds of facilities available, ^tc« The result would be that 



schools are used which are so unrepresentative of their respective * , 
social classed^t < that they really amount tb middle class schools in upper . 
and low^r class neighbourhoods « 'Does the study of suc^ lichools have ' 
much to say abou^ th^ relationship between teaching style^ and kind 
of school in general? Surely/ generalisations should be confined to the 

' unrepresentative subpopuXatlotis specified by the matching operation*. 

* * , * 

3. The causal arrov aablRuity ^ 'When correction operations such * 

* * , * 

as matching and partial c.orrelatldn are carried out^ Implicit assumptions 
about the causal direction bi^veen the nuisance yaviable^t'and the 4epen|dent 
variable are ctmrntonly-made* Very often in the social sciences tMs 

assumption is unwarranted. For example » in Investigatbing the relationship 

* ** - **• 

between ethnic background and'intrelligence^ we might dc^cide to control 

for social clasls^^ under the assumption that soc^^lr class and ethnic origin 

are related, and that social class in some sense determines intelligence^ 

However, if * the causal arrow connecting social class and intelligence- \ 

actually goes the other way, i/e., intelligence determines social class 

to some extent, then by controlling for social class, we are reducing a 

valid relet ionehlp between ethnic origin and intelligence. . / 

Although all of the defects are serious, the one of most immediate 

concernNto the present paper is the first. 

' . \^ The Problem of Systematic Unmatching; ^ y 

Redefining tba Igdepc^ndent Variable 

Of the three difficulties that Heehl associates with the use of 
control in tTTE research, the most telling, and complex is the problem 
with systematic unmatfchlng. In his example, Meehl desci^i^es a situation 
in which matching is used^ however the consequences are no different 



when either partial -cdAelatlond or analysis of covarlance is used. In 

fact Bay and Uaki^tiau (1972) have shown that in. the case of two treatments, 

the significance. test for the analyses of covariahcd is algebraically 

equivalent to' the significance test for the parcial* point biserial^ 

correlation, I.e. the '.correlation between the treatment (expressed as 

1,0) and the dependent variable vith th^> control variable partialled out* , 

With thfs in mind, it is easiest to look'at^ tlie problem from the simple 

vantage .poljat of the^partia^* 'correlation. 
* * * * * 

To understand what happens when ve partial the effects of a 

variable out of the relationship between two other variables, we must 

» 

realize that the partial correlation is merely the correlation between 
' two residuals • Suppose that X. and are two variables of Interest* 
Xj is a nuisance variable. Using simple regression techniques, we cTould ^ 
predict 5"^ froa X2 from X^ as follows: 



/ 
/ 



^ , • Xj^ - b^3 X3 + a 



If Ri " - Xj^, and ^2 ''^a * ^2' ^^^^ correlation between Rj^ and 

R2 is known as the partial correlation, and is symbolized 3 ^'^^ 
is equal to: • ^ 

^12 ^ ^13 ^23 1 



(l-r^ )(l-r2 ) ^ 1 

and we are el^lmlnating X^ in this algebraic sense. 

i » ' ' ' • 

. A second kind of coxfelktion, that is of Interest here, is the 

part correlation. If we had a variable X^, and correlated it with Rj^, 

then the result would be a part correlation. (It is the corr.elat'ion 
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batwettn variable 4 and that part of variable l'^vhic]i is uitcorr elated 

with varlabla 3.) The expression for a part corr^'.latipn is shown below. 

*- '# * 

'(1.3)4 " • ^ . 2 • ' • : ■ ' 



^ l-r" 
^ ^13 



\ 
\ 



It is Meehl^s arguoient that i^en you calculate a partial y . 

correlation b^t^en two variables jof interest , you tend to ^ke 

♦ ' — ^ 

greater than r^ > » i.e« you Increase the relationship between tlie 
independent variable, and some outside variable. This can be illustrated 
by supplying some ficticious but plausible yalCies to the r^ationships 

'aaong the varrdbles used by Heehl. • \ 

1 ^ 2 \ 3 , 

*1. Amount of Schooling 1.00 .70 \.60 

.^ ^ " \ 

2. Incowfe' ' . 1.00 . . .iifO 

r3. Intelligence , 1.00 



In the s^udy, we would have noticed 
have a fairly high correlation of *i7i, but if we partial out /he 'effects 



that aaounljC: of schooling and income 



of Intelligence, the part'lal congelation r^2 3) " This Indicates 

that even wltiTlntfeUigence pstrtialed ou6, there is still a^subst;antial 
correlation between amount of schooling and income. 

Now suppose that we construct some^ plausible values for 
achievement need that reflect the effect of Meehl's example. 



Amount of Schooling Income Intelligence. 

, t ^ * * 

Achievement Need .40 - .40 00' . 

Notice that the correlation between the amount ^f schooling at^d 
achijavement^need' is a modest .40. If we loc\ at the^^art correlation ^ 

s, * 

between- achievement need and amount schooling vith intelligence 



JO 



partlaled out» ve find that .the correlation^ is •SO: ' Meehl argues that ^ 

when you control for tha a^f^ects ot a xiuisance variable , you cia increase 
. ^ ^^.^ . ' ^ ^ ' ^ • , ~ • 

tha^ influence of soma other variable. In this *exanple» the correiatioti 

involving achievement need changed from % 4 to .5. Disregarding the 

insignificant (in a scientific sense) sisa of this changes » ve would - 

argue that what' happi^ns yhen partial correlations are calculated » is .that' 

' ,4 ^ ' ^ ' ' . . " » . . 

the variables, of interest are transfodiusd into new variables, i.e.»^the 

X's are changed itito X - X» and Vharaas^^the^old variable X might have been 

• > . ' .'^ , - ' • " ' ' 

relatively unrelated* ts> some outside variable the new variable can 

have quite a substantial relatioasKip with the outside variaj^ie. In 

our example » the newly craated'^varlable "Amou]\t of schcbllng with IQ held 

^ - . x< ^ f/ * 

'constant? has a higher correlatj^^n with achievement need thatw did the 

I ^.„^^.^^ '\ ^ . ' 

old variable "Amount of Schooling". 

If we consider the formula for part correlations (equation 2). 
we can see why this should be:* \ . , * - 

■ ■ • ^ / * \ ' 

•Variable 1 lis one of the variables of interest (perhaps the. 



independent variable). Variable 2 is the^, other variable of 

V 



interest'; 



Variable 3 is the puisanc^ variable or control variable 'that. is - 
Identified by 'tlie investigator 'for control. « * "'* 

Variable 4 is an outside variable that is not considered in 
the experiment. • ^ ' ' 

Now, r^^ is likely to be a pretty healthy correlat^lon, since' it is 
a nuisance variable of sufficient degree to have attracted attention. / 

The , expression 1 r^^» ^^1^ be less than one, and the larger r''^^ is» 

^ 2* * ^ * 

the smkller . 1 - r^^ will be. Thus the denominator of the expression 

for the pare correlation will have the effect of "magnifying" the 

^ \ ' " 

numerator. In'Meehl^s example, the value of r^^'was zero, and the effect 

^ ' ' ^* 

of partialing out^ intelligence was to increase ^the correlation between 



tht £t!4<tptndent Varl&blft axid the outside ^variable fron A to .5. It 

ialgl)t ba arguady that any outside variable that* Is correlated as nuch as 

' . • , • " ■ ' . •"^ 

•4 vith the independent variable » would il^self be identified as a ^ 

nuisance Variable and steps could be/ taken to< cont;rol for it. On the 

other handy if the correlation between- t^e 'batside variable and^tk \ 

control variable, is near 2erb» and the correlatton-between the independent 

varistble and the outside variable ds near zero, then Of course th^re 4:S ^ 

- I . ( , 

no problem » because the numerator of the expression is 2ero> and no - ^ 



amount of magnification by l'^^ r.^ can change that>»^ 

" The flidre sertou 
r^^ is maf^if led by 



^ The mdre serious problem arlTsea ifhen r<. is vei?y near aeei?p> and 



^13 



\ 



When r^ is. near zero» it' will almost surely be oyer looked in the. ):he<^ 
that biijds variables 1, 2. and 3, Of course, if'^3^ is very large^ fh^n 

variable 4. will be dragged to Lur attention on the coattails of 

- * - ^ * * . ' 1" ' \^ 

» variable 3. The ''area in question occurs ;wheh r^^ lies in the Interval 

-.1 + .2^'and''r2^ is fairly small^ say less than in absolute value. 

Consider the following hHothetlcal exAaple ot a curriculum "'^ 

•s. ' ^ • 

evalua,tioii situation in which there are two competing curricula. * The 
correlations' are - ^ 

. • ' / - \ - - , 

Curriculum (A and B) 1.00 ^ \ \ 

Achlevament* ' . ,80 " 1.00\ .* , 

^ Inteillgenoe . .50 '.60 1.00 

AAOiint of Teachat *^ ' .* 
Astlstanca- ' .20 ..20 -.40^ 1.00 • 



. ' ; , _ ■ . '10. • 

fSt correlation/ with the treatment variable are point blseriais% There - 
Is an apparent difference between the group a on Ihteliigencei so an 

^ analysis of feovarlance is suggested.* Thii Is ,the site as c^ilculating 
the partial point: biji^Jfial correlation bietween treatment If nd achievement 
With intelligence partialed ,out • * After plugging the .value? into the 
formila, ^^^2.3 " it i* «iOncluded that even wittTj-ntelHgence 

; partial^ed outp there Is^a treatment effect. But if Ve loolc at what. , 
ha^ip^s to i|:he relationship with amount of teacHer asf.lsta^ce^ we find 
that Strang^* thlng^s 'have happened • Inmost cldssrooma it is probably true 
thit there is a . small >ut negative correlation betweift Mdfint of 

assistance given and intelligence • Less intelligent students need and <getv 

' ' ' ' - " ^ / / . ^ * 

more teacher, assistance than'*aore Intelligent students. Let us suppose 

. th^t fh this case 9 the^ teacher iLn the treatment ^l(^h had. higher 
achlevei^ent tejried to give more help than the other\^acher. The part 

^rrelation between treatm^i^ with lnt!el3tigence partialled out and 
asEiount^ of teacher assistance turns out to be .46. By part falling out , 

(^telligence^ we have managed to increase tfhe relationship betwelen 
tr element and amount of teacher assistance f'^m .2-^to . 46 « \ * | \ 
\ ^ In a s^se what we have done is to f redefine the tr^tmW^ variable 
to be "Treatment ^th X^telllg^ce Partlalled Out"» and instead of 

confused the issue because we have Increased the confounding influence 
oi^ "Amount of Tocher Assii^tence*'. 

It might be suggested that\;the l^|^thetlcal example^ls-^fixed" 
.o paint the picture as darkly, as possible » and this is true» Let us try 
t9 determine.^ the conditions under whllch-we should be a)Larmed. For 
rearfons^ statedrearj)ller, the problem seeias to occur when^r^ 'becomes 

• ^ , ' I A * 

greater than' «4 in absolute value» and when r/. is lees [than .2 In 

• . \ ^ y , ' " X' 14 . ' - « 'N-^ 



mbsol^ute value, and when'r^^ is less than .4 in absolute ^yalue. jThsfte, ^ 
conditions insure t^at the outside variable vill.nbt be ic^ pnsldere d an :; 
appropriate candldate*<irMntrol , and it^ will* not be pulled ± ^ pn t he : 
coattails of the covaiiaterj5^^^^ ^(1,3)4 ^8^^®V^34 Sp^ paribus 
values of^rj^2» ^j^^^^hen-w^ji^ to see vhere the dai^er lles^ 

In Figure 1, the shaded araa is tVe airea of danger • The^ilefti- hand ^^^ 

. ■» "'^'^ - / /'i' ' 

figure shows various plbts for r^^^ - O^xthat i^, where the independexit 
v&rlable and the outside variable havjB noyddr relet ion. Here we can see 
that problems could occur when the cojPMlatioti between the coyariate 
and the independent variable be^OM .8 or greater itf absolute vaiue^. 
In educational research ythese kinds of correlations don't happen very, . 
much. For curriculian evaluation, it ^eems inconceivable that we.woiild 
select two groups fof comparison iftljey differ^ed by so much on a ; 

nuisance variable. ' . . • ^, • • 

, '\ , 

, ^FIGURE .1 About Here v ^ 

On the ^ight side various lines are plotted for r^^^" * -^-^ ' 
(Taking the x axis as-^n axis of symetry, the. mirtor image would result 
for « In this instanliet some plausible situations o^cur. If 

r-^ is as small as .4 in absplute- value, ve can boost the correlations 
between the outside variable and. the independent variable from .2 to .^4, 
making the groups as , different on the outside variable as they were on 
the cover late. This kind of si^tuatlon is destined to grey the head of 
the most pl.acld researcher r 



Some Side Issues 

' In passing one might ask If the use of analysis of covariJance to ^ 
Improve power In a true experln(*ftl;-4««-TnSe"effect of producing a 
systematic difference jLn randomly equivalent groups. The answer Is no 
as can be seen In the' two group case. 

^\ ^ ^ ; ; . ; 

Let X be the treatmtot\ variable scored '^1, 0, and t be^ the dependcint 
variable for example, achievement, atfd 2 be the covarlatej, -IQ, and W l>e 
an outside variable like motivation* Oveif the Ic^ng^run, > expected 
^value of r^^ is zero because people -are randomly assigned to groups, and 
the c\3varlate is measured before the treatmen£, Thus, * 



r 



xy«2 J 5 — 

1 - r^ 

and so the power is Increased^. But what happens to the partial 

correlation r ? Tojbegin with, ,because of the random assignment of 
' ^ ""XWaZ . ' ' _ *' ' ~* — — — • 

people to groups, r^ should be ^^ftfin the lot^g rUn. ,THat belng^the 

cas^, the partial correlation turns out to b'c^ 

/ ' . ' ^* 

0 - 0 X r_ , 
X » 52- « 0 

1 1 - r'' ■ 
wz 

Consequently » In the true experimental case, there is no expected 
mismatch on the outside variable arising from the use of a control 

- - 1 ■ 

vajrlable* 1 , . t 
It in alsO/df interest ta see if the problems that arise in NTE 
designs and the use of analysis of covarlance also arises in the use of 
analysis of .variance in the NTE design* For example, suppose there is a .>/ 
two curricOlm study,, in which groups are not randoutly assigned to 

- ' / . . . ' , - 
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traatments. If 'we think tliat intelligence has a possible effect /we 
might I try to control it by using it'las a factor in a treatment by IQ c. 
analysis of variance* We cnai* do this in two ways. * In-the first way/ 
we might dl|:hotomi2e , (or use any nuaber of levels) IQ by cutting below 



and aboVe 110,^ If IQ is a reasonable cause for the observed difference 
lli^the dependent variable, .(at this rather gross level), then we will . . 
finl that there are disproportionate numbers In the cells of th^ two \ 
way design. If we analyse^ the data^ using lea^t squares procedures for 
the unequal n JNOVA, then the problems described earlier will, occur, 
since the analysis is no different in principle than using analysis- of 
covariance with IQ levels and 1^ by treatment '3<ateractlon as covariates. 
And since IQ and treatment are correlated, the correction could serve to ^ 
increase the correlation .between the "adjusted" treatment variable and 
some outside variable, . . ' - \ 

If on the other hand, « after we make out groups on ZiQo we \ 
randomly throw out subjects to make the cell sizes equal, then we make 
the correlatfon between the independent variable and the nuisance 
variables zeroi^ So that r^ ° ^j^4' The same situation holds true 
in any two-way design in which we have equal cell .sizes, and_ subjects not 
assigned at ^random, . ^ « - 

Of course in most two factor NTE designs, the factors are chosen* 

because of the possible ralationship to the dependent Variable, and 

* - / 

not because of their relationship to each other* - . " . / 

, . Dlscussfon \ j 

- , ' - / 

In the past, design experts have been able to supply pat remedies 

- ■ ■ ^- ■ . • ' '/ 

to problems that are ralscid. Complexity of analytical methods hap / 



usually outstriped advances in design methodology, and so new procedures 
tould'be prescribed to overcome the Inadequacies of the old ones. In 
the. present circumstances, however, the problems are not so easily 
solved. I According to Crbnbach and lleehl (1955) a construct derives Its 
meaning from the network of relationships that connect ±t with other 

' I ' 

constructs and with obseryables. When we partial out, or control the 
effects of nuisance Variables we change the nomological network in whicti 
the variables of inteifest are embedded; Or, put another way, the 
relationships among residual variables are s ot the same as the ' 

relationships among the original variables. We cannot Interpret the 
residual' variables as if they had the same construct status as the 
original variables. 

Meehl notes, when we try to investigate the relationship • 
between naturally occurring characteristics by controlling for some 
nuisance variable, we are almost inevitaoly lead to the assertion of 
counterfactual conditional statement as: If dropouts and graduates had 
the smae IQ, they would earn different salaries. Traditionally, . 
researchers have acted as though the counterfactual p^emlse.^^(lf dropouts 
and graduates had the same IQ) could be true in isolation from aiSL other 
variables. We have seen that this is not true. When we correct f^ 
IQ we change the outside relationships. Additionally, Meehl argues 
that the implicit assumption does riot make common sense. A society in 
which 'dropouts and graduates have the same IQ may have such different 
sociologicSTmefelta^ms operating that the dynamics underlying Income, 
IQ and schooling would be radically different. 

Perhaps the most useful way to deal with the prdblem of 
interpreting NTE research is to live with the nuisance^ariables by 
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incorporatl^ig them into our aodels |)Shavior, By doing this, we 

' . ' . ' ^ * ' - * j, ' \ 

constriict models to fit tl^e world, ^rather thap constructing worlds to. fit 

,our aodels • In class^pbrn research and evaluation, If naturally. ; 

occurring characteristics confound** each other, it does not make sense on, 

either* scientific or Rfcagmatic grounds to try to isolate individtmal ' 

effects* The nature of the domain i^ which we w6rk is complex and ♦ I 

interactive* Our models and procedures must reflect this* ^ Too often we. 

have tried tg overcome simplistic Qbservation with complex 'analyses* It 

makejs more s^nse to take more observations across time in a'n 'attempt to 

capture the interweaving* o'f variables^ At the present stage of\r > 

sophistication, reliable description of changing relationships ;i;rill lead 



us f^rther than touched-up cross-sectional snapshots*^ 

\ ■ ■■ 



1 \ 
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^ V > ^ ^ IK n 'i^r ^ 
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Figure 1(a): Plbt of -3^^ vs. r^^ for r^^ « 0 

• ^ ■ FIGURE 1 



Figure 1(b): Plot- , of r 



(1.3)4 



vs. r3^-for r,,, - 



3W ! correlation between independent "y'arlable" with 
covarlate partialled "out, and outside variable 
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correlation between covariate and outside variable 
^13 * corVelation between independent variable and covariate 
'^14 • correlatiQi^etween indeperidbnt variable and out side, variable 
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